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Abstract 

In this paper, we consider the bacterial point-to-point and multiple-access molecular communications 
with ligand-receptors. For the point-to-point communication, we investigate common signaling methods, 
namely the Level Scenario (LS), which uses one type of a molecule with different concentration levels, and 
the Type Scenario (TS), which employs multiple types of molecules with a single concentration level. We 
investigate the trade-offs between the two scenarios from the capacity point of view. We derive an upper 
bound on the capacity using a Binomial Channel (BIC) model and the symmetrized Kullback-Leibler 
(KL) divergence. A lower bound is also derived when the environment noise is negligible. For the TS, we 
also consider the effect of blocking of a receptor by a different molecule type. Then, we consider multiple- 
access communications, for which we investigate three scenarios based on molecule and receptor types, 
i.e., same types of molecules with Different Labeling and Same types of Receptors (DLSR), Different 
types of Molecules and Receptors (DMDR), and Same types of Molecules and Receptors (SMSR). We 
investigate the trade-offs among the three scenarios from the total capacity point of view. We derive 
some inner bounds on the capacity region of these scenarios when the environment noise is negligible. 

I. Introduction 

Molecular communication (MC) has stimulated a great deal of interest because of its potential broad 
applications. There are different mechanisms for MC, among which diffusion is the most favorable, as 
it does not require any prior infrastructure. In diffusion-based systems, information might be encoded 
into the concentration, type, or releasing time of the molecules. For instance, in Q, an on-off keying 

*This paper has been presented in part at the IEEE International Symposium on Information Theory (ISIT), Wan Chai, Hong 
Kong, June 2015. 
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modulation is proposed where molecules are released only when the information hit is one. It is shown 
that if there is no interference from the previous transmission slots, the channel can he modeled hy a 
Z-channel. In Q, Q, new modulation techniques based on multiple types of molecules are presented. 
Two models for diffusion-hased channels have been proposed, namely small and large scales. Diffusion 
process is viewed as a probabilistic Brownian motion in the small scale model, whereas it is described 
by deterministic differential equations in the large scale model. In this paper, we concentrate on the 
large scale model which reflects the average effects of diffusion. However, to derive the large-scale 
diffusion capacity of MC, one has to deal with the reception process at the receiver side. Two reception 
models are considered for a passive receiver. The first model is a perfect absorber where the receiver 
absorbs the hitting molecule. The second model, which is more realistic, is the ligand-receptor binding 
receiver, where the hitting molecule is absorbed by the receptor with some binding probability, 0, ©. 
The randomness in ligand-receptor binding process is modeled in © and a closed form solution for 
this modeling is derived by using Markov chains. Ligand-receptors are modeled by a Markov chain in 
0 , by a discrete-time Markov model in 0 , and by a BIC for a bacterial colony in ©. The BIC is 
defined by P{y\x) = (”)x^(l — where fhe inpuf is x G [0,1], fhe oufpuf is y G {0,1,..., n} and 

n, fhe number of trials, is a given natural number. Average and peak constraints on the input x may 
exist. The capacity of this channel without average and peak constraints, for large values of n, behaves 
as 2 log 2 ^ -t- logvr 0. However, there is no explicit upper or lower bound on the capacity of the BIC 


when n is not large enough. An algorithm for computing the capacity of the BIC was presented in 110 1 
using convex optimization methods. 

On the other hand, the bacteria based multiple-access communications have been studied in |[TT|-|[T^ 
for diffusion channel and ligand-receptor, where the transmitters use binary on-off keying modulations 
employing the same type of molecules but with different labeling. In these papers, the capacity of the 
multiple-access channel (MAC) is simply computed as the sum of the capacity of the channels between 
each transmitter and the receiver. In (TTJ, the expected concentration of bound molecules is computed. 
Then, by approximating the number of delivered molecules as the normally distributed random variable, 
the maximum detection probability is calculated, and based on the result, by modeling each user channel 


as a binary symmetric channel, the capacity of the channel is computed. In 112|, the channel randomness 
effect has been modeled by adding an additive Gaussian noise to the concentration of bound molecules. 
Then, by using the Gaussian channel model approximation, the capacity of each user channel is derived. 


In 1131, the capacity of each user channel is computed by representing the diffusion channel as a binary 
test channel. In all these works, the average interference from the other transmitters is taken into account 
in calculating the binding probability. In this paper, however in contrast to the previous works, we 
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examine the instantaneous effect of the multiple-access interference instead of its average value. In the 
following, we first concentrate on a point-to-point molecular communication and evaluate its capacity 
and the upper and lower hounds. Then we consider three multiple-access scenarios and for each, we 
evaluate the capacity region and some inner hounds. 

Our main contrihutions are as follows: 

• Point-to-Point Communication: We investigate the trade-offs between two hacterial point-to-point 
communication scenarios for ligand-receptors with fixed total number of molecules and receptors: (a) 
multi-type molecular communication with a single concentration level, and (b) single-type molecular 
communication with multiple concentration levels. At the first glance, scenario (a) introduces new 
degrees of freedom and reduces the intersymbol interference (ISI). However, since the number of 
molecules per type (the power per type) reduces increasing the number of types, we should examine 
the benefit of using different types of molecules. To make the comparison between scenario (a) 
and (b), we adopt the model of Q in this work. In addition, a Markov model for the interactions 
between different types of molecules near the receptor is presented and the capacity for this model 
is computed numerically. 


Upper and Lower Bounds for the BIC Capacity: Using KL divergence bound of |14|, we derive 
an upper bound on the capacity of the point-to-point BIC model under given average and peak 
constraints on the channel input (Theorem [T]). Based on numerical evidence, we believe that this 
upper bound works well in the low SNR regime (which can occur in MC systems). A lower bound 
is derived on the point-to-point BIC capacity under average and peak constraints in the case of no 
environment noise in Lemma [T] 

Multiple-Access Communication: We investigate the trade-offs among three multiple-access bac¬ 
terial communication scenarios for ligand-receptors with fixed total number of receptors: (a) Using 
the same molecule type with different labeling for different transmitters and one receptor type at the 
receiver (DLSR), (b) Using different molecule types for different transmitters and different receptor 
types at the receiver (DMDR), and (c) Using the same molecule type for the transmitters and one 
receptor type at the receiver (SMSR). Scenarios (a) and (c) share the receptors and introduce a new 
degree of freedom. However, the benefit of using different types of molecules in scenario (b) should 
be examined. Scenario (a) has also the advantage that the transmitters use a self-identifying label 
and therefore seems to have better performance than scenarios (b) and (c). To compare the three 
scenarios, we compute their total capacities numerically. By assuming two transmitters in Section 
V-A[ we derive some inner bounds on the capacity region of the three scenarios under average and 
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Fig. 1: Two scenarios: LS and TS 


peak constraints in the case of no environment noise. 

All logarithms are in base e in this paper. This paper is organized as follows: in Section |T^ we present 
the system model for point-to-point communication scenarios, whose capacities are discussed in Section 
III The interaction of molecules near the receptor is modeled in Subsection |II-A In Subsection III-A a 


new upper bound on the capacity of the BIC is presented by considering peak and average constraints. 


Subsection III-B includes a lower bound on the capacity of the BIC by extending the Z-channel. In 


Section IV three scenarios for multiple-access communication are presented, whose capacity regions 
and total capacities are discussed in Section |V[ The achievable rates for these scenarios are provided in 


Subsection V-A Section VI includes the numerical results, and finally concluding remarks are given in 
Section IVIII 


II. Point-TO-P oiNT System Model 

In this section, we describe two bacterial point-to-point communication scenarios with ligand-receptors. 
Level Scenario (LS): Here, the transmitter encodes information at multiple concentration levels to 
create the codewords. At the transmitter and the receiver, there is only one colony with n bacteria where 
each bacteria has N receptors; i.e., nN receptors in total. All these n bacteria produce just one type of 


molecule. This scenario is shown in Fig. la 


Type Scenario (TS): This scenario uses multiple types of molecules at the transmitter and the receiver. 
We assume the same total number of n bacteria (as in LS) are available which are equally divided into m 


colonies at both the transmitter and receiver as shown in Fig. lb As such, each colony has n/m bacteria. 
Moreover, different colonies at the transmitter produce different types of AHL molecules. Furthermore, 
the colonies are synchronized at the transmitter. Similar to the LS scenario, each bacteria has N receptors. 
Therefore, there are nN/m receptors in total per each colony, i.e., each type of molecule. Each colony 
can detect its own molecule type, and as a result, produces different color Fluorescent Proteins (e.g.. 
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GFP, YFP, ...) which are used hy the receiver to decode the received signal. In addition, we assume that 
all receptors of a colony are independent and sense a common molecule concentration. 

In both scenarios, we assume that there is no intersymhol interference (ISI). In other words, we assume 
those molecules, who do not hind to the receptors in the current time slot, will he degraded to the next 
time slot and hence will not interfere with molecules from the next time slot. This assumption, together 
with the large-scale diffusion channel property, results in a linear channel. For simplicity, we further 
assume that no attenuation occurs in the channel. Therefore, the received concentration Ar is equal to 
the transmitted concentration Ag. At the receiver with ligand-receptors, the prohahility of binding at the 
steady state is given by @ 


Pb = 




( 1 ) 


where 7 is the input gain and k is the dissociation rate of trapped molecules in the cell receptors. If we 
consider an environment noise with concentration Ane, due to the molecules of the same type from other 
sources, the probability of binding becomes pb = 

In LS, we only have one type of molecule and its binding probability is equal to 

^ 


„LS _ 

Pb — 


X + ALS + ^^ 


( 2 ) 


where X is the received concentration at the receiver and is the concentration of the environment 
noise. We can view the LS scenario as a BIC as follows: 


P^^{Y = y\X = x) = 


nN 


(x + (1 - /p. (a; + )) 


LS\\^^-y 


( 3 ) 


/p, : [0,oo][0,1], y G {0,1, ...,niV}. 


The function fp^{.) is the binding probability function. From Q, we have fp^{X + Ane) = x+A^"'+^ • 
As such, the function fp^{.) is an increasing and concave function. 

In TS, we have different types of molecules. Flere, we assume that the binding processes of different 
molecule types are independent and every receptor binds to its own molecule type and two different 


types do not bind to one receptor. We investigate a more general model in Subsection II-A by taking 
into account the interaction of different types of molecules in TS. The probability of binding for the ith 
type of molecule is given by 


Plf = 


Xj + All 


(4) 

^nCi ' 

where Xi is the received concentration of the ith type of molecule and is the concentration of the 
environment noise for the ith type of molecule. Without loss of generality, we assume A^^ = A^e and 
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the same 7 and k for all types of molecules and receptors. This scenario can he viewed as m orthogonal 
BICs as follows: 


PP{Y^ = yi\Xi = Xi)= j fy^ixi + All) (1 “ + ^nej) ^n, (5) 

tiN 

/p, : [0,oo][0,1], Vie {0,1,..., -}. 

m 


A. Blocking of Receptors 


In the TS scenario, we assumed orthogonal parallel channels for different types of molecules with no 
interference between them (i.e., no blocking of a receptor by molecules of another type). However, when 
there are different types of molecules, they may interfere with each other. In other words, one type of 
molecule may block another type of molecule from binding to its receptor counterpart. For example, 
consider m = 2 with two types of molecule, A and B and their corresponding receptors as Ra and Rb. 
The molecule type A near Rb may prevent the molecule type B from binding to Rb and vice versa. 
Assume that Xa and Xb are the received concentrations of types A and B. The main reaction kinetics, 
for binding of the molecule type B to its receptor, is modeled as Q 

Xb + Rb'^^XRb, (6) 

Kb 


where 7 s > 0 is the association rate of the molecule type B with receptors of type B and kb > 0 is the 
dissociation rate of XRb complex. Now, we characterize the blocking for the receptor type B, similar 
to the reaction kinetics formulas by 


Xa + Rb 


Block.A 

1b 


, r)Block.A 

> R^ 


Xa + Rb ^ 


Block 

B 




TyBlock,A 

Kb 


( 7 ) 


where 7 ^ ’ > 0 is the blocking rate of by molecule type A and is the unblocking rate 

of If we do not take the blocking into account, then we have a reaction kinetics for each type 

of receptor to its molecule type. As in Q, we define a Markov model for the no blocking case based 
on ®, as shown in Fig. 1^ for m = 2. Likewise, according to Q, we propose a Markov model for the 
blocking case, as shown in Fig. We consider three states. The full state is when the receptor binds 
to its type, the empty state when the receptor is free, and the block state when the receptor is blocked 
with a different molecule type. Solving the chain for the no blocking case, the steady state behaviour 
of the system-reaction formula is obtained as O- Solving the chain for the blocking case, we have the 
following probabilities of binding and blocking for the receptor type B: 


Pb = PFull = 


^Xb 

Kb ^ 


Block,A 

Jsioak.AXA 


Block,A 

7b 


kI^B + ^Blook.A 


Xa + 1 


PBlock — 


Block,A 

7b 


kI + ^Blo.k.A 


Xa + 1 


( 8 ) 
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Kb 



IbXb 

(a) With no blocking 


1 - - -tbXb 
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Fig. 2: Two Markov models for receptor type B 


If we increase the concentration for one type of molecule, the prohahility of binding for another type is 
decreased as expected. This model can he extended for m > 2 via, 




E m 
7=1 


Block, j 

-rX, 


Pbi = PFull, = 


2 iX- + V™ 


Block ,j 


fX, + 1 


') PBlock, — 




_ i±Y- J- _ 

where pb. and pBlock, the binding probability of the ith type of receptor to the molecules of its type 
and the blocking probability of the ith type of receptor by the molecules of the other types, respectively. 
The blocking and unblocking rates for the ith type of receptor by the molecules of the jth type are 
defined by and respectively. It is also possible to consider the environment noise for 

the binding and blocking probabilities. Hence, the probability of binding for the ith type of molecule is 
given by 


Block,j 


(9) 


Tk-jXj + 1 


TS,B 

Pb^ 




7i 

Ki 


-{Xi + \laok,j {Xj + + 1 

We can view the TS scenario with blocking as a multi-input multi-output BIC as follows: 


( 10 ) 


P.- 


.TS,B 


{Xi — yi\Xi — xi,..., XjYi — Xm) 


nN 




r 

, d^rn^ -^ne. 


)y 


--Vi 


i = 1,..., m, 


( 11 ) 


where fp,^ (Xi,..., A^|) = p^f’^ is the probability of binding when the blocking is considered. 


III. Point-to-point capacity analysis 

We investigate the capacity for the two scenarios. In both scenarios, the output is discrete. Further, we 
assume the environment noise and average and peak concentration level constraints. 

In LS, we have a single colony with input X and output Y. The peak and average concentration 
constraints for the input are 0 < X < and E[X] < asAg, respectively. 

Then, we obtain the capacity for LS as 

Cls= max I{X;Y), X e {0,1,...,nX}. (12) 

P{x\. 

0 <Y<A,, E[A:]<«»A, 


draft 












In TS, we use Xi to denote the input of the ith colony to the channel and Yi to denote the output of 
the ith colony at the receiver. The peak and average concentration constraints for the input of the ith 
colony are 0 < Xj < ^ and E[Xj] < as respectively. 

Hence, the capacity can he written as 

tiN 

Cts = max I{Xi,...,Xm-,Yi,...,Ym), XiejO, 1 ,..., - }. (13) 

TTl 

If we do not consider the blocking, the capacity could he ohtaind as follows: 

nN 

CTS = 'mx max I{Xi;Yi), yje{0,l,..., - }. (14) 

P{xi): m 

For a fair comparison of Cls with Cts-: we consider = Ane- Since we have a BIC in 

LS and m BICs in TS with no blocking, we consider a BIC for the two scenarios as follows: 

P{Y = y\x = X)= fy^{x + Ane) (1 - fpSx + Ane))^ , (15) 

/p, : [0,oo][0,1], y G {0,l,...,iV'}. 

Since P{y\x) is a Binomial distribution, we have = ^'fpbi^)- The peak and average 

constraints for the input of the BIC are 0 < X < and E[X] < UgA'g, respectively. Note that for LS 
and TS we have the following parameters: 

. LS: N' = nN and A'^ = 

• TS with no blocking: N' = ^ and A^ = ^. 


A. Capacity Upper Bound 

There is no closed form for the BIC capacity. As such, for the first time, we propose an upper bound 
on the capacity of the BIC at the low SNR regime by considering average and peak constraints using the 


symmetrized KL divergence, referred as KL upper bound in 114|. We first explain the KL upper bound 
briefly. Let L>sym(Flk) = D{p\\q) + D{q\\p). Then, 


U{P{y\x)) = maxL>sym(T’(x,y)||P(x)P(7/)) > max/(X;y) = C{P{y\x)). 

P(x) P(x) 

The KL U{P{y\x)) is always an upper bound on the capacity. It is straightforward to show that 


(16) 


{P{x,y)\\P{x)P{y)) = Ep(,,p) logP(y|X) - Ep(,)p(p) logP(y|X). (17) 

Now, we state our upper bound in the following theorem. The proof of this theorem can be found in 
Appendix [A| 
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Theorem 1. Consider a point-to-point BIC ai' (151 and any input probability mass function (p.m.f) P{x). 
Then, the symmetrized KL divergence upper bound has the following explicit formula: 


I{X- Y) < U{P{x, y)) = iV'Cov {X + Ae), log , (18) 

where Cov(X, y) = E[Xy] — E[X]E[y]. Furthermore, imposing the average intensity constraint agA'^ 
and peak constraint A'^, we get 


^Binomial(-^*(2/1 ®)) ■ 


max UiP{x,y)) 

P{x): 

0 <X<^'^, E[X]=o,A'^ 


= N' 


/ 1 '^7p if Phil's + ^ne) — fpiiotgA'g + Ane)] E, if (=t=), 


JPb 
fpb 


(19) 


E, 


if (*=1=), 


where E = log ( (A'+aI)) )’ (*) • fpMsA'g + Ane) < and {**) : fpMsA'g + 


A \ \ fpbiX~^^Pe) j_T 

Ane) > ——2 -• Eence, 


C = 


max I{X]Y) <UB\nom\AP{y\x))- 

P{x): 

0 <X<A'„, E[X]=a.A'^ 


( 20 ) 


We compute this KL upper bound numerically in Section VI Based on the numerical evidence, this 
upper bound works well for all Binomial channels (such as MC channels) with low capacity. 


B. Capacity Lower Bound 

We obtain a lower bound on the capacity of the BIC when the environment noise is negligible. 
We assume a binary input, while in the previous section, a continuous input was assumed. Under this 
assumption, the resulted capacity is a lower bound on the capacity of the BIC. We compute a closed 
form formula for the lower bound in the following lemma. 


Lemma 1. Consider a point-to-point BIC as GH) and any input p.m.f P{x), in which Ane 
{0,^^} and E[X] < UgA'^. The capacity of this channel is obtained as 


C 


H 

< 


1 

l-|_es(Pc) 


gjpo) 

l_l_e 9 (Pc) 1 


ag > 


_ 1 

— Pc log 1 

1 —Pc+e 


0 0^s —Pc log p^ ; 

, 1-pc+e i-Pc 

where H{p) = -plogp - {I - p) log(l - p), g{p) = pc = and fi{a,p) 

p) log a + aplogp — (1 — a + ap) log (1 — a + ap). 


0, X G 


( 21 ) 


a{l — 


Proof. The proof is provided in Appendix 

If we consider N' = 1, then the channel would reduce to a Z-channel. 


□ 
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(a) DLSR scenario 


(b) DMDR scenario 


(c) SMSR scenario 


Fig. 3: Three schemes of multiple-access in molecular communication systems 


IV. Multiple-Access System Model 

We descrihe three hacterial multiple-access communication scenarios with ligand-receptors based on 
molecule and receptor types differences. 

DLSR Scenario: As shown in Fig. the transmitters send the same type of molecule (AHL) with 
different labelings and the receiver employs one type of bacteria (receptor). At the receiver, there is only 
one colony with n bacteria where each bacteria has N receptors; i.e., nN receptors in total. 

DMDR Scenario: As shown in Fig. each transmitter uses a different type of bacteria and a different 
type of molecule (AFIL) and the receiver employs different types of bacteria (receptor). At the receiver, 
there are m different colonies with n/m bacteria where each bacteria type has N receptors; i.e., nN/m 
receptors in total for the ith molecule type. 

SMSR Scenario: As shown in Fig. the transmitters send the same type of molecule (AHL) and 
the receiver employs one type of bacteria (receptor). At the receiver, there is only one colony with n 
bacteria, where each bacteria has N receptors; i.e., nN receptors in total. 

In all scenarios, we assume that there is no intersymbol interference (ISI) and no attenuation occurs 
in the channel. Further, we assume that Xi is the received concentration from the Ah transmitter. 

In the DLSR scenario, since different labelings are used pT|-|[T3|, it is possible to distinguish between 
the molecules emitted from different transmitters. For example, consider m = 2 with two different 
labelings of a molecule, Li and L 2 . Assume that and X^'^ are the received concentrations of the 
different labelings Li and L 2 , respectively. The main reaction kinetics, for binding of the molecules with 
different labeling to the receptors, are modeled as 

X^^ + XR^^, X^‘^ + R^ XR^"^, ( 22 ) 

where we consider the same association and dissociation rates for the two different labelings. Similar to 
the blocking case, we propose a Markov model for the labeling scenario, as shown in Fig. |^for m = 2. 
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Fig. 4: Markov model for labeling 


The steady state behaviour of the system-reaction formula is obtained as 

XU x^^ 

Pb^ - PFull by Li - x^^ + ~ + '^'' 

This model can be extended for m > 2 via, 


XLi 


Pb, = 


(23) 


(24) 


ET=1 f ’ 

where is the binding probability of the receptors to the molecules with the ith type of label. It is also 
possible to consider the environment noise for the binding probabilities: 


„DLSR 

Pbi 




(25) 


with parameters ^dlsr. 


Er=l(^,+^^ef^) + f 

where is the concentration of the environment noise for the molecules with the ith type of 

label. Without loss of generality, we assume A^^^^ = Let the output Yi be the number of 

receptors bound to the molecules with the ith type of label. The outputs have multinomial distribution 
'■■■'> Pb„ 

^ (2/1) • • ym\xi ) •• •) XjYi) — Piy^l — 2/1) • • Pm — 2 /m | 2 fl — Xi, Xm — ^m) 

nN-YX=i Vi 

J 

In the DMDR scenario, we have different molecule types for the transmitters. Without blocking, the 
binding probability for the ith type of molecule is obtained as 


(„«) („JV - ESI' j /1 _ 


(26) 


DMDR 

Pb, 


Xi + 

X* + AgMDR + ^ ’ 


(27) 


where A^^^^ is the concentration of the environment noise for the molecules of the ith type. Without 
loss of generality, we assume A^^^^ = Let the output Yi be the number of receptors bound 

to the molecules of the ith type. Then, Yi ~ Binomial and 

P ( 2 / 1 ) • ••) 2/m I Xm) — P(Yi — 2/1 , ..., Ym — 2/m |2fl — Xi, ..., Xm — Xm) 

m ynN^ 


n m = y^\x. = x.) = m-^] (1 - 

i=i i=i ^ 


--Vi 


(28) 
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TABLE I: Variables of the multiple-access scenarios 


Variable 


Definition 


pDLSH 


^DMDR 

Phi 


DMDR,B 

Pb, 


^SMSR 

Pb 


rtDLSR^ 


oDMDR 


} ym 1 ^ 1 ) ■ • • 5 ) 

• 7 ym I ^1 5 ■ ■ •) ) 

P^^^^{y\xu:;X^) 


i{x,+ajLsh)+^ 






EAi 

E™jX,+as"«R+^ 

a -1 


Block, j 


nr.i (f 

nAT _ 

n m /IL«x/ DMDR,b\^' (, DMDR,b\ rn yi 

^^l ( y,, >[Pb, ) (^l-Pb. ) 




However, by considering the blocking, taking the same steps as deriving we have the following 
binding probability for the ith type of molecule: 

S(X + 


DMDR,B 

Pb, 


1{X, + ADMDR^ + + AgMDR^ + 1 

Here, we have Yi ~ Binomial and 
pDMDR,B(^y^^ ...,ym|xi, ...,Xm) = P{Yi = yi, ...,Ym = ym\Xi = Xi, ..., = Xm) 


(29) 


llP{Yi = yi\Xi = XI, ...,X^ = x^) = ll T-] (l - 


j=i 


■*■■*■ V % / 

i=l V / 


Ph 


DMDR,B\ ™ P' 


• (30) 


In the SMSR scenario, we have one molecule type for the transmitters. The receiver senses the sum 
of the concentrations X^. Hence, the probability of binding is equal to 


Pb 


V _L aSMSR 

i=l “T ^ne 


(31) 


TT=lXr+ASMSR 

where A^msr is the environment noise. Let the output Y be the number of bound receptors. Then, 

Y ~ Binomial {nN, pSMSR'^ 

= PiY = y\X, = (pf""'')'!! 


(32) 


Table |I] summarizes the variables defined in this section. 
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V. Multiple-Access Capacity Region Analysis 


In this section, we investigate the capacity region of the MAC for the three scenarios. In all scenar¬ 
ios, the output is discrete. Further, we assume the environment noise and consider peak and average 
concentration level constraints for the input of the ith transmitter as 0 < Xj < and E[Xj] < 

The DMDR scenario with no blocking can he viewed as m orthogonal point-to-point channels and the 
capacity of each channel can he computed according to Section [111] So here, we consider the blocking. 

Since we have one receiver with m outputs in the DLSR and DMDR scenarios, we may view these 
scenarios as SIMO (single transmit antenna and multiple receive antennas) MACs and compute the 


capacity region as the convex hull of rate tuples {Ri ,..., Rm) such that 1151 

^R^< (Yu .., Ym)\XiI^)) VX c {1,..., m}, 


(33) 




for some p.m.f ni=i ^i^i) that satisfies 0 < Aj < Ag., E[Aj] < ag.Ag., i = 1, The total capacity 
in these scenarios can be computed as follows: 


a 


DLSR,DMDR _ 
total 


max 

0<Xi<A,., E[Xi]<ce,,A,., 


IiXi,...,X^-,Yi,...,Ym). 


(34) 


The SMSR scenario can be viewed as a SISO (single transmit antenna and single receive antenna) 
MAC. The capacity region of this channel is the convex hull of rate tuples (i?i,..., Rm) such that flSj 


^Ri< I(A(X); y| A(X^)) VX C {1,..., m}, 

i£l 


(35) 


for some p.m.f ni=i P{^i) that satisfies 0 < Aj < Ag., E[Aj] < ag.Ag., i = 1, The total capacity 
in this scenario can be computed as follows: 


f.SMSR _ 

'-'total — 

0<Xi<A,., E[Xi]<a,.A,., i=l,...,m 


I{Xi,...,Xm]Y). 


(36) 


There is no algorithm to compute the capacity region of the MAC numerically |16|. Instead, the 
total capacities of the three scenarios are computed numerically in Sention We remark that the total 
capacity in the MAC is active and therefore it is sensible to compute it. 

For a fair comparison of the total capacities, we consider A^^^^ = A^A^^ = — ^ne- 


A. Capacity Region Inner Bounds 

We consider two transmitters and obtain inner bounds on the capacity region of the multiple-access 
communication in the three scenarios when the environment noise is negligible. We assume a binary 


input to arrive at an inner bound, which is computed numerically in Section VI 
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DLSR, DMDR: We may view the DLSR and DMDR scenarios as interference channels with full 
receiver cooperation. The capacity region of the interference channel is an inner hound on the capacity 
region of this channel. The time-division inner hound for an interference channel consists of all rate pairs 
{Ri, R 2 ) such that 

Ri<kCi, R2<{l-k)C2, (37) 

for some k G [0,1], where Ci and C 2 are the maximum achievable individual rates as follows | [T5| : 

Ci= max IiXi-Yi\X 2 = X 2 ), C 2 = max /(Xs; = ^i). (38) 

X2, P[Xi) Xl, P{X2) 

This inner hound is computed in Lemma for the DLSR and DMDR scenarios with binary inputs 
and considering peak and average concentration constraints. It is shown in this lemma, whose proof is 
provided in Appendix that the maximum achievable individual rate for each transmitter in the two 
scenarios occurs when the signal concentration of the other transmitter is zero and therefore the closed 
form formula for the maximum achievable individual rates is obtained. 

The interference-as-noise inner bound for an interference channel consists of all rate pairs (i?i, R 2 ) such 
that i fTSl l 

Ri<I{Xi-Yi), R2<I{X2;Y2), (39) 

for some p.m.f P{xi)P{x 2 )- This inner bound is computed in Lemma|^for the two scenarios with binary 
inputs and considering peak and average concentration constraints. The proof of this lemma is provided 
in Appendix [Pj 


Lemma 2. Consider interference channels with two sender-receiver pairs and P^^^^{yi,y 2 \xi,X 2 ), 
{yi,y 2 \xi,X 2 ), and any input p.m.f P{xi)P{x 2 ), in which = 0, xi G 

{0, X 2 G { 0 ,^ 52 }, IE[Ari] < cind IE[X 2 ] < 052 ^ 52 - time-division inner bound on the 

capacity region of these channels is obtained as 


Ri < kCi, i?2 < (1 - k)C2, 


Cr = 


H 


g(pc,o) 

a(Pc,-n) ’ 


l^e9(PciQ) j i_^e9(Pcio 


a.s, > 


— Pc.in Pc,-n ’ 


I-Pc +e i-Pcio 


(40) 


i = 1,2, 


0 < a.o < 


— PCj^Q^OSPciQ 5 


1 —Pci 0 +'^ 


for some k G [0,1], where H{p) = —p\ogp — (1 — p) log (1 — p), g{p) = 
p) log a + ap log p — (1 — a + ap) log (1 — a + ap). For the DLSR scenario, Pao 


and for the DMDR scenario with blocking, pc^g 



i = 1,2. 


and fi{a,p) = —a(l — 
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Lemma 3. Consider interference channels with two sender-receiver pairs and P^^^^{yijy 2 \xi,X 2 ), 
P^^^^'^{yi,y 2 \xi,X 2 ), and any input p.m.f P{xi)P{x 2 ), in which = 0, xi G 

{0,^s^}, X 2 G { 0 , 74 s 2 }, IE[Xi] < and E[X 2 ] < Us^As^. The interference-as-noise inner bound 

on the capacity region of these channels is obtained as 


Ri < - loga* + ai{{l - ajfjPda + aj^p^J log((l - ajfjPao + ctj.pa,) 


- ai I -—— + (1 - ap)pcio + otppc,^ ) log ( -—— + (1 - Oijfjpc,^ + aj^pc, ), * = 1,2, 


Cti 


Oii 


(41) 


for some ai G [0, asj, ci 2 £ [0,cks2]> where ji = 2 and j 2 = 1- For the DLSR scenario, pc-^ = 

nN / \nN 

, i = 1,2 and for the DMDR scenario with blocking, p^-^ = 


Block, 




> Pc.^ = 


Block,ji 


As ,.+1 




rA.._+l 


, i = 1,2, where ji = 2 and j 2 = 1 - 


Block,ji '‘'^^ji 

For Ag^ = Ag^ = Ag, we have pcm = Peso Pen = Pc 2 i- Assume a^i = «S 2 = ^s- The points where 
Ri = are obtained when ai = q ;2 and are computed as follows: 


Ri = i?2 = k 


- logo' + a'((l - a')Pcio + «'Pcii) log ((1 - «')Pcio + «'Pcii) 

. {1 — a' ,, , \ , (1 — a' ,, , 

- « I - -! -h (1 - a )pcio + a Pen log --h (1 - a )pcio + « Pen 


a 


a 


, (42) 


for some k G [0,1], where a' = min{Q;,as} and a is the solution of the following equation: 


((1 - 2a)pcio + 2apcii) log ((1 “ «)Pcio + “Pen) 


- ((1 - 2a)Pcio + 2apcn “ 1) log 


1 — a 


a 


+ (1 - «)Pcio + aPcn = 0 . 


(43) 


SMSR: As mentioned before, we may view the SMSR scenario as a SISO MAC. According to 1151 
for a MAC, the maximum achievable individual rates are 


Ci= max I{Xp,Y\X 2 = X 2 ), C 2 = max I{X 2 -,Y\Xi = xi). (44) 

X2, P{Xl) Xi, P{X2) 

Using these rates, the time-division inner bound can be obtained as ( [T7| ). This inner bound is computed 
in lemma for the SMSR scenario with binary input and considering peak and average concentration 
constraints. The proof of this lemma is provided in Appendix 

Lemma 4. Consider a MAC with two transmitters P^^^^{y\xi, X 2 ) and any input p.m.f P{x\)P{x 2 ), 
in which A^^^^ = 0, xi G {0,Asi}, X 2 G E[Xi] < ag,Ag^, and E[X 2 ] < ag^Ag^. The 
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time-division inner bound on the capacity region of this channel is obtained as 
Ri < /cmax{cio,cii}, i ?2 < (1 -/c) max{c 2 o, C 21 }, 


CiO = 


H 


9iPo,o) 




> 


^-Pc^^Tog”Pc^^ ’ 


1-Pcio+e i-PciO 


i = 1,2, 


fl{o!si , Pcio )) 


0 < Os, < 


— PC^Q log PC^Q ? 


1 -Pcio+e 


nN 

1=0 


(1 - a'i)P{y = l\xi = 0 ,Xj, = log ( (1 - a') + a! 


jP{y = l\xi = As„Xj^ = As^J 
P{y = l\xi = 0,Xj^ = A J 


+Q'P(y = l\xi = As^,Xj^ = ^s^Jlog (1 - a') 


P{y = l\xi = 0,Xj^ = As^J 


P{y = l\xi = As,,Xj. = As-J 


+ O-j 


i = 1, 

(45) 


for some k G [0,1], where ji = 2, j 2 = 1, H{p) = -plogp-{l-p)log{l - p), g{p) = fi{a,p) = 

, a' = minjaijOsJ, 


-a(l - p) logo: + aplogp - (1 - a + ap) log (1 - a + ap), p^o = \ 
i = 1,2, where ai, i = 1,2 is the solution of the following equation: 


nN 

E 

/=o 


/ P(y = l\xi = As-.Xi. = As-) 

P{y = (|i-, = 0, xy = A.„) log ([(1 - a,) + a, pfa ^ o.l,.'= A J 

P{y = l\xi = 0,Xj^ = As^J 
P{.y — l\xi — Ag^jXj^ — Ag A) 


-P{y = l\xi = Ag.,Xj^ = ^s.Jlog (1 - ai) 


+ oil 


= 0, (46) 


where ji = 2 and j 2 = 1- 


VI. Numerical Results 

In this section, we first consider a point-to-point communication, and evaluate the rates for the TS 
and LS scenarios as well as the lower and KL upper hounds. Then, we evaluate the total capacity and 
achievable rates for the three scenarios of the multiple-access communications. 


A. Point-to-Point Capacity for LS and TS and Effect of Blocking 

We evaluate the rates of the TS scenario given in ( pA) ) and the LS scenario given in ( [T^ , using the 
Blahut-Arimoto (BA) algorithm fTT] . The unit of the concentration of molecules is nano-Moles per litre 
(nM). We assume N = IQ,n = 16, and use the values 7 = 71 = ... = 7m = 0.0004 (nM min)~^ and 


K = Ki = ... = Km = 0.1 min“^ from | |18| . Note that we consider small values of N and n because of 
the time complexity of the BA algorithm for large values of N and n, although in practice, these values 
can be very large. 

Fig. 5a shows the capacity of TS with no blocking and LS, for m = 2,4, 8,16 when A^f = A^^ = 0. It 
is seen that increasing the number of molecule types, m, from 1 improves the performance (for fixed A,,), 
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(a) = 0 (b) A^^ = All = 5 

Fig. 5: Capacitiy of TS with no blocking and LS for ag = ^. 



Fig. 6: Capacitiy of TS with and without blocking and LS for ag = ^ and A^e = 0. 


which is expected due to the parallel transmission of the molecules. Flowever, if we continue to increase 
m, and accordingly decrease the number of bacteria in each colony to n/m, the performance degrades. 
The reason is that decreasing the concentration level of TS in Q decreases the binding probability. 
Hence, there is an optimal m. For example, for Ag = 80, this optimal value lies between m = 4 and 
m = 8. This implies that for Ag = 80 and m = 2, 4, the capacity of TS is higher than LS, whereas for 


m = 8,16, the capacity of TS is lower than LS. Similar conclusions can be made from Fig. 5b in the 
presence of the environment noise AH = AH = 5. 

Fig. shows the effect of blocking by showing the capacity of LS and TS for m = 2. We considered 
two blocking cases: 

• Low Blocking: ^ ^ min)-\«:f 


Block,2 _ ^Block,i _ p, nnoQ /nX/r ,^Block,2 _ ^Block,i _ q ^5 rnin”^. 
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Fig. 7: Capacity and KL upper bound in terms of Fig. 8 : Capacity and Lower Bound in terms of A'^ 

Ane for the BIC with A'^ = 80 and as = ^. for the BIC with N' = 20 and 

• High Blocking; 7 ^ = 72 = 0.0005 (nM mm) , = ^2 = * 

As illustrated, the blocking decreases the capacity of TS. For small values of Ag, LS outperforms TS in 
all cases of blocking. 


B. Lower Bound and KL Upper Bound on the Capacity of the Point-to-Point Channel 

Our proposed KL upper bound, ([g, and the capacity are depicted in Fig. |7] by considering the 
logarithmic scale. It can be observed that the distance between the KL upper bound and the capacity is 
constant in the logarithmic scale. Therefore, the gap between the capacity and the upper bound decreases 
as the environment noise increases. The lower bound in ( |2T] ) along with the capacity are shown in Fig. 
For simplicity, we consider average constraint to be inactive. For small values of A'^, our lower bound 
is tight which means the binary distribution is a capacity achieving distribution for small values of A'^. 


C. Multiple-Access Total Capacity 


In this section, we evaluate the total capacities of the DLSR and DMDR scenarios given in (34i and 


the SMSR scenario given in (36 1 , using the extension of the BA algorithm for the total capacity of the 


MAC |19|. We assume = 10, n = 6 , m = 2. Similar to the previous sections, we use the values 
7 = 7 i = 72 = 0.0004 (nM min)“^, k = ki = K 2 = 0.1 min”^, and consider no, low, and high blocking 
cases. 


Fig. 9a shows the total capacities of the three scenarios in terms of Ag^ = Ag^ = Ag when A^^^^ = 
A^^^^ = A^^^^ = 0. It is observed that DLSR has the highest total capacity for all values of Ag. 
For small values of Ag, SMSR has higher total capacity than DMDR, whereas for large values of Ag, 
SMSR has lower total capacity than DMDR. The reason is that when Ag is small, sharing the receptors 
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Fig. 9: Total capacity of DLSR, DMDR, and SMSR for 



Fig. 10: Total capacity of DLSR, DMDR, and SMSR with continuous and binary inputs for q;<j^ = = \ 

and Ane = 0. 


is useful. But when ^4^ increases, using different types of molecules becomes more useful. Since DLSR 


has both of these advantages, it is more effective than the other two scenarios. Fig. 9b shows the total 
capacity for the three scenarios when = A^^^^ = A^^^^ = 5. Similar conclusions can be 

made in the presence of the environment noise. 

The total capacities of the three scenarios for both continuous and binary inputs are depicted in Fig. [T^ 
It can be observed that in all three scenarios, the total capacities with binary inputs are equal to the total 
capacities with continuous inputs for small values of Ag. For large values of ^4^, the total capacities of 
DLSR and DMDR with binary inputs reach to the same value since all receptors become full and these 
scenarios behave the same. However, the total capacity of SMSR with binary input reaches to a lower 
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" Time-Division Inner Bound 
■ Interference-as-Noise Iimer Bomid 
' Capacity Region 
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Fig. 11: Capacity region and Inner bounds for DLSR, DMDR, and SMSR with binary inputs for 
1 


as^ = 5 and Am = 0. 


value since it doesn’t have the advantage of using different types of molecules or self-identifying labels. 


D. Inner Bounds on the Capacity Region of the MAC 

The capacity region inner bounds for the DLSR, DMDR, and SMSR scenarios, provided in Section 
V-A[ are depicted in Fig. 11 The capacity regions of the three scenarios with binary inputs are shown in 
Fig. [^by considering Ag^ = Ag^ = 100. It is observed that DMDR with low blocking and DLSR have 
the same square shaped capacity regions, which indicates that for this parameter setup, these scenarios 
almost experience orthogonal MACs. These two scenarios have the largest Capacity region and SMSR 
has the smallest capacity region and the capacity region of DMDR with high blocking is in between. 


Fig. 13 shows the maximum achievable equal rates given in (42), when considering interference as 
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Fig. 12: Capacity region of DLSR, DMDR, and 
SMSR with binary inputs for = 5 

and Ane = 0 . 



Fig. 13: Maximum achievable equal rates by 
viewing interference as noise for DLSR and 
DMDR with binary inputs for 0 ;*^ = | 

and Ane = 0 .. 


noise, in terms of Ag for DMDR with low and high blocking and DLSR. It is observed that the rate for 
DLSR is larger than DMDR and reaches to a constant value as Ag increases. Though the constant value 
is almost the same for DMDR with low blocking and DLSR, the value is higher than that of DMDR 
with high blocking. The reason is that when considering binary inputs and increasing Ag, DMDR with 
low blocking behaves like DLSR since all receptors become full. However, DMDR with high blocking 
behaves worse than DLSR since some of the receptors are always blocked. 

Vll. COCLUSION 

In this paper, we first investigated the capacity performance of point-to-point communication scenarios, 
including Level and Type scenarios. We also modeled the blocking as a Markov process and derived the 
probabilities of binding and blocking. Next, we derived a new upper bound on the capacity of the BIC 
at low SNR-regime based on the KL divergence upper bound as well as a lower bound. As expected and 
confirmed by simulafions, the blocking would decrease the capacity of type scenario. Then we proposed 
three scenarios for the multiple-access communication, including same types of molecules with Different 
Labeling and Same types of Receptors (DLSR), Same types of Molecules and Receptors (SMSR), and 
Different types of Molecules and Receptors (DMDR) scenarios and investigated their capacity region 
and total capacity. We derived some inner bounds on the capacity region of these scenarios when the 
environment noise is negligible. Based on numerical results, DLSR outperforms the other scenarios for 
all values of the maximum signal level from the total capacity point of view. For small values of the 
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maximum signal level, SMSR has better performance than DMDR, whereas for large values of maximum 

signal level, DMDR has better performance. 
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Appendix A 

Proof of Theorem[T] 

We find KL upper bound for the BIC as follows: 

I{X-,Y) < ^ [P{x,y) - P{x)P{y)]\ogP{y\x) 




= ~ log ( (^ ) - fp, {x + Ane))^' 


x,y 

= E 


P(x,v) 


log 


A' 


-E 


P(x)P{y) 


log 


A' 


+ ^P(x,y) [y log fpt {X + A ne)] 


^P(x)P{y) [y fpb -^ne)] ^P{x,y) V) fpb -^ne))] 

- Ep(^)p(y) [(A^' - y) log (1 - /p,(x + Ane))] 

^p{x,y) [y log fp^ {x ^p{x)p(y) [y log {x + [y log (1 {x + A^g))] 

-Ep(x)P(y) [y log (1 - fp, {x^A ne ))]] 

fpb Aji^) 


= 


X \ \ y 


fpb -^ne) 


P{x) 


“ (n [J2y^^y\^n (X! i°g i t -p(^) 


x \ y 


= E 


^7pi,(a: +A„e)log 


fpb P Afig) 


= A'Cov (A -F A„e), log ^ 


1^ fpb Ane) J _ 

fpb + Ane) 


fpb P Ayjg) 


-E[N'fp^{x + Ane)]'E 


1 I fpbi^ P Ane) 

1 - fpb(^P^ne)J. 


,(1 — fpb(^ P Ane)). 

As mentioned earlier, fp^{X + A„e) is an increasing function. Hence, 

fpbi^ P ^ne) 


Cov {^fpbiXP Ane)j log 


(l-/p7X + Ape)) 


> 0 


. A further observation is that 


C < maxV'Cov(/,,(X + a„,),l„g 
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is always achievable with a binary random variable X. We consider two points, xi and X 2 with proba¬ 
bilities Pi and p 2 . We have 


maxCov(/p,(X -y Ane),\og{F)) = max {E[fp^{X + Ane) logF] - E[fp^{X + A„e)]lE[logF]) 

P{x) P(x): 

E(/pJX-rA„.))<a,2t', 

0<X<A'^ 

max {E[{fp,{X + Ane) -E[fp,{X +Ane)]) logF]), 

Pix): 

E(/pJX-rA„,))<a,2t', 

o<x<a;, 


where F = ^ ^ ■ Now, based on the analysis in 114 Appendix C], the optimal distribution is 

given by P{x) = ^ ~ ^s) “ f (A'+A —upper bound is obtained as 


max -Tim. a ^ 

fpi^{Ag + Ane) 


ry 

* ^ [fpMs + Ane)-asA',]E, 


where E = log 


EAX+Ar..)il-U(A„^)) 

/pAA„e)(i-/„AA'-rA„.)) 


. The upper bound is equal to 


fvbi.^s-^s F Ane) 
fpb (^s “b Fne) 


[fPhil's + ^ne) 


fpbi^sAg + Ane)] log 


fpbi^s + ^ne)(l — fpbi-Fne)) 
fpb{^ne)il- — fpbi-F's + Ane)) ’ 


for asA'g < 


fpb iX+^nn) 

2 


and 


fpbiX+^ne) 

4 


log 


f fpbiX+Ap.)ii-fp,Ap,))\ 


otherwise. 


Now, if we consider fp^(X + Ane) = x+A^’+^ ’ upper bound is: 


^Binomial(-P(yl^)) • 


max 

P{x), 

E[X]=a,2l'^, 0<X<A;, 


UiPix,y)) 


= N' 


/ I ^Ip (A^+'!4„r) ^ “ fpbictsA'g + Ane)]E, if (*), 


JPb 

fpb A's+^pe) 


E, 


if {**), 


where E = log ( 


Ane) F 


fpbiX+^pc) 


(/pA^L)(l-/pA^?+^"e)))’ ■ Ubi^^sA's + Ane) < 2 (**) ' fpbi^^sA'g + 


Appendix B 
Proof of lemma[I] 


Let 


Pc = (I-Pb)^'. 


The BIC transition probabilities by considering binary input is characterized as 


P{y = 0|a: = 0) = 1, P{y = i|a: = 0) = 0, i = 1,..., N', 

P{y = i\x = A'J = (^^^yi{l-pb)^'-\ i = 1 , 


DRAFT 




















25 


Assume P{x = A'^) = a. The average constraint results in a < q;<j. The lower hound on the BIC capacity 
without considering the average constraint could he derived as follows: 

C = max/(X; Y) = maxH{Y) - H{Y\X) 

a a 

= maxH{Y) - P{x = 0)H{Y\x = 0) - P{x = A',)H{Y\x = A'J 

a 

N' 

= max — } C(P{y = i\x = log {aP{y = i\x = A^)) 

i=l 

— (1 — a + apc) log (1 — a + apc) — aH{Y\x = A^) 

= max —a(l — pc) log a + apc logpc — (1 — a + apc) log (1 — a + apc)- 

a 

Taking a derivative with respect to a from the above expression and setting it to zero we obtain a* = 

-Pc log ^ * Then, 

l-Pc+e i-Pc 

c = h (—- 

\l + e9(p-) J 1 + e9ip-) 

where H{p) = —plogp —(1—p) log (1 — p) and g{p) = Now, if we consider the average constraint, 
the equation for C is valid for a* < Ug since the mutual information is concave in a. But for a* > a*, 
the capacity lower bound is obtained for a = ag. 


Appendix C 
Proof of Lemma[2] 

We prove the lemma for the DLSR scenario. The approach for the DMDR scenario is the same. Let 

Pbii =Pb,^^^{xi = Ag^,X 2 = X 2 ), Pb^, =Pb,^^^(xi = Ag^,X 2 = X 2 ), 


Pc, = p{yi = 0|xi = Ag,,X 2 = X 2 ) = 


Pc,o = P{yi = 0^1 = ^s„X 2 = 0) = 


X2 + ^ 


nN 


Ag, + X2 + ^ 


nN 




Channel transition probabilities for the first transmitter by considering binary inputs xi G {0,As^} and 
X 2 G {0, A 52 } characterized as 


P(yi = 0|xi = 0,X2 = X 2 ) = 1, 


nN—i 


P{yi = i\xi = Ag,,X 2 = X 2 ) = ^ 

j=o 


nN\ f nN — i 


Pb^Pb,,^^ - (Pbii +Pb2i)) 


nN—i—j 


i = 0,.... 


nN, 
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Assume P{xi = = ai. The average constraint for the first transmitter results in ai < ag^. In 

the following, the maximum achievable individual rate for the first transmitter, Ci, is computed. The 
approach for computing C2 is the same. Without considering the average constraint we have 


Cl = max I{Xi;Yi\X2 = X2) = max H{Yi\X2 = X2) - H{Yi\Xi,X2 = X2) 


= max H{Y,\X2 = X2) - P{xi = 0 )H{Yi\xi = 0 , A2 = X2) - P{xi = Ag,)H{Y^\xi = Ag„X2 = X2) 

3 ^ 2 , Oil 

nN 

= max - y^aiP(yi = i\xi = As^,X2 = X2) log (aiP(2/i = f|xi = As^,X2 = X2)) 
i=\ 

- (1 - ai + aipci) log (1 - ai + aipci) - aiH{Yi\xi = Ag^ , X2 = X2) 


= max -ai(l -pcjlogai + aiPd logPci -(!-«! + aipcj log(l - ai + aiPcJ- 

3 ^ 2 , Oil 


Taking a derivative with respect to ai from the above expression and setting it to zero we obtain = 
1 


Then, 


l-Pci+e 


Cl = max ' H 


1 


9{Pc 


1 _l_ esfPci) y i_|_gC/(Pci) 


where H{p) = —plogp — (1 — p) log (1 — p), g{p) = Taking a derivative with respect to X2 from 


the above expression we obtain 

d , , s, p'c 9'f 1 

dx2"^ (1 + e 3 (P‘=i ))2 \^i + e 9 (P‘=i) 

Since H'{p) = log('!^), we have 


Pci 5 '(Pci)(l + 

( 1 + 


d Pci5''(Pci)(p(PcJeS'(P‘=i)+ l + eS'(P‘=i)-5((pcJe^?(P‘^i)) y + esfpcj) 

-—IaAXi-,Y\X2=X2) = -^- - 

dX2 


(1 + e^'(p=i ))2 


(1 + e^^(P‘=i ))2 


nNA, 


X-i + 


K \ nN —1 


> 0 and g'iPc) = 


and this is a negetive value for all X2 > 0 since p^^ = ^ +X2+- +x2+- 

p' log Pc 

— ,, > 0 . X2 can take two values 0 and A.,. So the maximum occurs when X2 = 0 . Hence, 


Ci = H 


1 


g{p. 


O\o ) 


l + e5(P-io)/ l + e^(P CIO ) 


Now, we consider the average constraint. For both values of X2 = 0 and X2 = Ag^, if Ug^ > a.\{x2), the 
maximum for I{Xi;Yi\x2 = X2) occurs when ai = ai(x2) and if 0 < ag^ < a\{x2), the maximum 
occurs when ai = Ug^ since /(Ai,Yi|X2 = X2) is concave in ai. Let a^g = al(x2 = 0 ) and a\i = 
a\{x2 = AsJ. If > a\Q and > al^, Ci = max{ 4 .^(yi; Yi|x2 = 0 ), Iai,{Xi;Yi\x2 = 
As 2)} equals to /q,*^(Ai; Yi|x2 = 0 ). If ag^ > a^g and ag^ < Ci = max{/Q,*jj(Ai; Yi|x2 = 
0),Ia,,iXi;Yi\x2 = As 2)} equals to /„.^(Ai; Yi|x2 = 0 ) since (-^1; ^1 ^2 = 0 ) > Iai,{Xi]Yi\x2 = 


DRAFT 



27 


As^) > Ia,^iXi]yi\x2 = As^). If 0 < Osi < aio and 0 < < a^, Ci = max{Ja^^ (Xi; yi|x2 = 

0 ), Iq,^^ (Xi; yi|x2 = As2)} equals to Ia^^{Xi]Yi\x2 = 0 ) since 


d 


—/(Xi; y|X 2 = X2) = aiPci log 


aiPci 


< 0 


dX 2 ' ^ ° 1 _ _|_ 

and I(Xi;yi|X2 = X2) is a decreasing function with respect to X2 for all values of ai G [ 0 , 1 ]. If 
0 < Osi < a^o and a^i > an, Ci = max{/Q,^^ (Xi; yi|x2 = 0 ), (Xi; yi|x2 = ^S2)} equals to 
/„^^(Xi;yi|x2 = 0 ) since (Xi; yi|x2 = 0 ) > /a*^(Xi;yi|x2 = 0 ) > (Xi; yi|x2 = As^). 


Appendix D 
Proof of Lemma[3] 

We prove the lemma for the DLSR scenario. The approach for the DMDR scenario is the same. Let 

Pfeii =Pb,^^^{xi = As,,X 2 = X 2 ), Pb2i =pZ^^^{xi = A^^,X2 = X2), 


Pbi2=Pb, {Xi= Xi,X2 = As,), Pb„=p,,^ ^^{Xi= Xi,X2 = As,), 

( H 

Pc^„ = P{yi = Ojxi = As,,X 2 = 0 ) = 




Pc^^ = P{yi = Ojxi = A^^,X2 = As,) = 


As, + ^ 


nN 


Asi + As - + ^ 


Channel transition prohahilities hy considering binary inputs xi G { 0 ,As^} and X2 G are 

characterized as 


P{yi = Ojxi = 0 , X2 = X2) = P{y2 = OjXi = xi, X2 = 0 ) = 1 , 


nN—i 

P{yi = i\xi = As,,X2 = X2) = ^ 

i=o 

nN—i 

P{y2 = ijXi = xi,X2 = As,) = ^ 

j=0 


nN\ f nN — i 


- (I’Ll +P621)) 


nN—i—j 


nN\ (nN — i 

j 


pLpA'^ - (Pbi2 +P622)) 


nN—i—j 


7 = 0 ,..., nN, 

7 = 0 ,..., nN. 


Assume P{xi = = ai and P{x2 = A^^) = a2- The average constraints result in ai < and 

a2 < ots,. The interference-as-noise inner hound for this channel is computed as follows: 


Ri < /(Xi; Xi) = ii'(yi) - H{Y^\X^) = ii'(yi) - P(xi = 0)P(yi|xi = 0) - P(xi = A,jP(yi|xi = A,J 

nN 

= - ^ai((l - a2)P{yi = ijxi = A^j,X2 = 0) + a2P(yi = ijxi = As^,X2 = A^J) 
i=l 

X log(ai((l - a2)P{yi = 7 |xi = A^^,X2 = 0 ) + a2P(yi = ijxi = As^,X2 = As,))) 

- ((1 - a2)((l - ai) + aipcio) + «2((1 - ai) + aipciJ) 

X log((l - a2)((l - ai) + aiPcio) + « 2((1 - ai) + aiPciJ) - aiP(yi|xi = A^J 
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nN 

= -ai logai ^((1 - a2)P{yi = i\xi = As^,X2 = 0 ) + a2-P(yi = i\xi = As^,X2 = 
i=l 

+ ai{H{Yi\xi = J + ((1 -a2)pc,o + a2Pcii) log ((1 - a2)pc^o +«2Pcii)) 

- ((1 - ai) + ai((l - a2)pcio + «2Pcii)) log ((1 - ai) + ai((l - a2)Pcio + «2Pcii)) 

-aiH{Yi\xi = As,) 


= -ai(l - (1 - a 2 )Pcio “ a 2 Pcii) logai + «i((l- “ « 2 )Pcio + a 2 Pcii) log ((1 - a 2 )Pcio + « 2 Pcii) 


Ol 


1 — ai 
Q!l 


+ (1 - a 2 )Pcio + « 2 Pcii^ log + (I - O 2 )pcio + a 2 Pcii^ ^ 


= -logai +q:i ((1 - a 2 )Pcio + 02 Pcii) log ((1 “ « 2 )Pcio +a 2 Pcii) 


- Ol + (1 - « 2 )Pcio + « 2 Pcii^ log + (I - « 2 )Pcio + a 2 Pcii^ • 

for some ai G [0 ,Q!sJ and 02 G [0 






f?2 < -loga2 + a2((l - ai)Pc2o + “iPcsJ log ((1 - ai)Pc2o +«iPc2i) 

- 012 {- - ^ + (1 - ai)Pc20 + «1PC21 ) log ( - — + (1 - ai)Pc20 + «1PC21 ) , 

V “2 J \ 012 ) 

For As^ = As 2 = ^s, we have Pdo = Pc2o Pcu = Pc2i- The points where Ri = R2, without 

considering the average constraints, are as follows: 


Ri = R 2 = A;max-loga + a((l - a)pcio + “FciJ log ((1 - a)Pc^o +«Fcii) 


— a 


“ + (1 - a)pcio + «Pcii ) log (-—^ + (1 - a)Fcio + aPcii ), 


a ) \ a 

for some k G [0,1]. Taking a derivative with respect to a from the above expression and setting it to 
zero we obtain 


((1 - 2a)pdo + 2apcii) log ((1 “ «)Pcio + “FciJ 

- ((1 - 2a)Pcio + 2aFcii - 1) log [-—- + 

y a 

If we consider the average constraints with ag^ = = ag, the above equation for the optimum value 

of a is valid if the solution of the equation is lower than or equal to ag since I{Xi]Yi) for ai = 02 = a 
is concave in a. If the solution is higher than ag, the maximum occurs when a = ag. 


(1 - a)Pdo + «Fcii = 0 . 


Appendix E 
Proof of LemmaH] 


Let 


Pbio =Pb^^^(xi = Ag^,X2 = 0), Pbol =Pb^^^(xi = 0,X2 = Ag^}, 
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Pfeii =Pb^^^ixi = As,,X2 = As,), 

Pco = P{y = Okl = As,,X2 = 0) = 

Channel transition probabilities by considering binary inputs xi G { 0 ,yls^} and X2 G {OjAs^} are 
characterized as 

P{y = 0 |xi = 0 ,X 2 = 0 ) = 1 , 

P{y = i\xi = As„X2 = 0 ) = ^ = 0 ,...,nN, 

p{y = i\xi =0,X2= As,) = ^ = 0 > •••> ^N, 

P{y = i\xi = As„X2 = As,) = i = 0,...,nN. 

Assume P{xi = = ai. The average constraint for the first transmitter results in ai < as,. In 

the following, the maximum achievable individual rate for the first transmitter, Ci, is computed. The 
approach for computing C 2 is the same. Without considering the average constraint we have 

Cl = max I{Xi;Y\X2 = X2) = max H{Y\X2 = X2) - H{Y\Xi,X2 = X2) 

= max H{Y\X 2 = X 2 ) - P(xi = 0)H{Y\xi = 0,X2 = X 2 ) - P{xi = As,)H{Y\xi = As„X 2 = X 2 ) 

X2, Oil 

N 

= max - P{y = i\X2 = X2) log P{y = i\X2 = X2) - (1 - ai)H{Y\xi = 0 , X2 = X2) 

X2, Oil ' ^ 

i=0 

- aii 7 (y|a:i = ^2 = X2). 

We can write this as follows: 

Cl = max{cio,cii}, 

CIO = max/(Xi; y|a;2 = 0 ), cn = max/(yi; y|x2 = As,). 

CXi Oil 

For cio we have 

nN 

cio = max - } P{y = i|x2 = 0 ) log P{y = i\x2 = 0 ) - aiTf (y |xi = As^, X2 = 0 ) 

i=0 

nN 

= max-y^aiP(y = i|xi = As,,X2 = 0 )log{aiP{y = i|xi = As,,X2 = 0 )) 

i=\ 

- (1 - ai + aiPcio) - at + ctip^o) - aiiT(y|xi = As,,X2 = 0) 

= max-ai(l - Pc,o) logai + aiPcio logPcio - (1 - «! + aiPcio)log(l - ai + aiPc,„). 

ai 



DRAFT 



30 


Taking a derivative with respect to ai from the above expression and setting it to zero we obtain a^Q = 


l-Pcio+e 


CIO 


, Then, 


CIO = H 


9 {P, 


ClO ) 


l + eS(pcio)y i + e 9 (Pcio)’ 

where H{p) = —plogp— (1 — p)log(l —p), g{p) = If we consider the average constraint, the 

above equation for cio is valid if > a^Q since I{Xi;Yi\x2 = 0 ) is concave in ai. If 0 < < a^Q, 

the maximum occurs when ai = a^i- For cn we have 

nN 

cii = max/(Xi;y|x2 = Ag^) = max-y^P(y = i\x2 = Ag^)\ogP{y = i\x2 = Ag^) 

i=0 

- (1 - ai)H{Y\xi = 0 ,X 2 = Ag^) - Q;iiF(y|xi = Ag^,X2 = Ag^) 

nN 

= max - y~^((l - Q;i)P(y = i\xi = 0 ,X 2 = Ag^) + aiP{y = i\xi = Ag^,X2 = 


Ql 


i =0 


X log((l - ai)-P(y = i\xi =0,X2 = Ag^) + aiP{y = i\xi = Ag^,X 2 = Ag^)) 
- (1 - ai)H{Y\xi = 0,X2 = Ag^) - Q;iiF(y|xi = Ag^,X 2 = Ag^) 


= max — 

ill 


nN 

E 

i=0 


(1 - a.jPfa = i\x, =0,x, = A.J log (d - a,) + 


+aiP{y = i\xi = Ag^,X 2 = ^s 2 )log ( (1 - ai) 


P(y = i\xi = 0,X2 = Ag^) 


+ cri 


P{y = i\xi = As^,X 2 = Ag^) 

Taking a derivative with respect to ai from the above expression and setting it to zero we obtain 

P(y = i\xi = Ag^,X 2 = Ag^] 


nN r 

E 

i=0 


P{y = i\xi = 0, X 2 = ^^ 2 ) log (1 - ai) + «! 


-P{y = i\xi = Ag^,X 2 = Ag^) log (1 - ai) 


S 2 J 


P{y = i\xi = 0,X2 = A, 
P{y = i\xi = 0, X 2 = A, 


+ Cdl 


= 0 . 


P{y = i\xi = Ag^,X 2 = Ag^) 

If we consider the average constraint, the above equation for the optimum value of ai is valid when the 
solution of the equation is lower than or equal to ag^ since I{Xi; Yi|x 2 = Ag^) is concave in ai. If the 
solution is higher than ag^, the maximum occurs when ai = a^i- 
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